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Abstract —In this paper, we analyze the dynamics of spreading processes taking place over time-varying networks. A common 
approach to model time-varying networks is via Markovian random graph processes. This modeling approach presents the following 
limitation: Markovian random graphs can only replicate switching patterns with exponential inter-switching times, while in real 
applications these times are usually far from exponential. In this paper, we introduce a flexible and tractable extended family of 
processes able to replicate, with arbitrary accuracy, any distribution of inter-switching times. We then study the stability of spreading 
processes in this extended family. We first show that a direct analysis based on Ito’s formula provides stability conditions in terms of the 
eigenvalues of a matrix whose size grows exponentially with the number of edges. To overcome this limitation, we derive alternative 
stability conditions involving the eigenvalues of a matrix whose size grows linearly with the number of nodes. Based on our results, we 
also show that heuristics based on aggregated static networks approximate the epidemic threshold more accurately as the number of 
nodes grows, or the temporal volatility of the random graph process is reduced. Finally, we illustrate our findings via numerical 
simulations. 

Index Terms —Dynamic random graphs, complex networks, epidemics, stochastic processes, random matrix theory. 

- ♦ - 


1 Introduction 

NDERSTANDING spreading processes in complex net¬ 
works is a central question in the field of Network 
Science with applications in rumor propagation [11, mal¬ 
ware spreading |2|, epidemiology, and public health [ 31. 
In this direction, important advances in the analysis of 
spreading processes over time-invariant (TI) networks have 
been made during the last decade (see [4| and (5) for 
recent surveys). Under the time-invariance assumption, we 
find several recent breakthroughs in the literature, such 
as the rigorous analysis of mean-field approximations |6|, 
the connection between the eigenvalues of a network and 
epidemic thresholds 0, 0, new modeling tools for 

analysis of multilayer networks (To) , and the use of control 
and optimization tools to contain epidemic outbreaks |11], 

d), i i3i, gg. 

In practice, most spreading processes of practical interest 
take place in networks with time-varying (TV) topologies, 
such as human contact networks, online social networks, 
biological, and ecological networks 1151. A naive, but com¬ 
mon, approach to analyze dynamic processes in TV net¬ 
works is to build an aggregated static topology based on 
time averages. When the time scales of the network evo¬ 
lution are comparable to those of the spreading process, 
the static aggregated graph is not well-suited to study the 
dynamics of TV networks, as pointed out in [16], |17|. Using 
extensive numerical simulations, it has been observed that 
the speed of spreading of a disease in a TV network can be 
substantially slower than in its aggregated static representa¬ 
tion 1181. This observation is also supported by the study 
of spreading processes in a real TV network constructed 
from a mobile phone dataset |l9 |. More recent studies point 
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out the key role played by the addition and removal of 
links ©, as well as the distribution of contact durations 
between nodes [21] in the dynamics of the spread. The 
works mentioned above provide empirical evidence about 
the nontrivial effect that the dynamics of the network has 
on the behavior of spreading processes. 

Apart from these empirical studies, we also find several 
works providing theoretical support to these numerical 
observations. The authors in (22) , |23] | derived the value of 
the epidemic threshold in particular types of TV networks, 
assuming that all nodes in the network present a homo¬ 
geneous infection and recovery rates. In (24) , Perra et al. 
proposed a model of temporal network, called the activity- 
driven model, able to replicate burstiness in node/edge 
activity and analyzed contagion processes taking place in 
this model in [ [25) . Karsai et al. proposed in 126] a time- 
varying network using a reinforcement process able to 
replicate the emergence of strong and weak ties observed 
in a mobile call dataset. A wide and flexible class of TV 
network model, called edge-Markovian graphs, was proposed 
in 0 and analyzed in (28) . In this model, edges appear 
and disappear independently of each other according to 
Markov processes. Edge-Markovian graphs have been used 
to model, for example, intermittently-connected mobile net¬ 
works (29) , (30] and information spread thereon (3l) . Taylor 
et al. derived in (32) the value of the epidemic threshold 
in edge-Markovian graphs and proposed control strategies 
to contain an epidemic outbreak, assuming homogeneous 
spreading and recovery rates. 

It is worth remarking that, although most existing anal¬ 
yses of spreading processes over dynamic networks rely on 
the assumption that nodes present homogeneous rates and 
the Markov processes used to generate edge-switching sig¬ 
nals are identical, these assumptions are not satisfied in real- 
world networks. Furthermore, most theoretical analyses 
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mentioned above assume that edges appear and disappear 
in the network according to exponential distributions. How¬ 
ever, as was found in several experimental studies (33) , (341, 
(35) utilizing radio-frequency identification devices (RFID), 
the probability distribution of contact durations in human 
proximity networks is far from exponential. Therefore, it is 
of practical interest to develop tools to analyze spreading 
processes in TV networks with heterogenous rates and 
non-identical edge-switching signals able to replicate non¬ 
exponential switching patterns. 

In this paper, we study spreading processes over TV 
networks with heterogeneous rates and non-identical edge¬ 
switching signals. First, we propose a wide class of TV 
networks where edges appear and disappear following ag¬ 
gregated Markov processes (36). Since the class of aggregated 
Markov processes contains all Markov processes, the pro¬ 
posed class includes all edge-Markovian graphs (27) . We 
furthermore observe that, due to the modeling flexibility 
of aggregated Markov processes, the proposed class of TV 
networks can replicate human-contact durations following 
non-exponential distributions with an arbitrary accuracy. 
Second, we theoretically analyze the dynamics of spreading 
process over the proposed class of dynamic graphs. We 
model the dynamics of spreading processes on this class us¬ 
ing a set of stochastic differential equations, which is a time- 
varying version of the popular iV-intertwined SIS model |9|. 
Third, we derive conditions for these stochastic differential 
equations to be globally exponentially stable around the 
infection-free equilibrium, i.e., the infection 'dies out' ex¬ 
ponentially fast over time. One of the main challenges in 
this analysis is to derive computationally tractable stability 
conditions. For example, as will be illustrated later, if we 
simply apply a recently proposed stability condition (37) 
based on the direct application of Ito's formula for jump 
processes (see, e.g., |38|), we obtain a stability condition 
that requires the computation of the largest eigenvalue of 
a matrix whose size grows exponentially with the number 
of edges in the network. Hence, this condition is hard (if 
not impossible) to verify for large-scale networks. In this 
paper, we use spectral graph theory (39) to derive stability 
conditions for the set of stochastic difference equations in 
terms of the largest eigenvalues of a matrix whose size 
grows linearly with the number of nodes in the network. 

This paper is organized as follows. In Section [2j we 
introduce the notation and preliminary facts used in the 
paper and, then, introduce a flexible model of TV networks 
model called aggregated-Markovian random graph process. 
In Section[3] we state computationally tractable stability con¬ 
ditions for spreading processes taking place in this dynamic 
network model. In Section [4j we illustrate our results with 
some numerical examples. The proofs of the theorems are 
presented in Section [5] 


2 Preliminaries and Problem Statement 

This section starts by introducing notation in Subsection 


2.1 


Then, in Subsection 2.2 we review preliminary facts about 


spreading processes over static networks. In Subsection |2.3( 
we introduce the class of TV network models under consid¬ 
eration. We finalize this section by stating the problem to be 
studied in Subsection l2.4l 


2.1 Notation 

For a positive integer n, define the set [n] = {1,... ,n}. 
For c <E R, define c~ = (|c| — c)/2. Let sgn(-) denote the 
sign function over R, which can be extended to matrices by 
entry-wise application. The Euclidean norm of a; £ R n is 
denoted by ||x||. Let I n denote the n x n identity matrix. 
A square matrix is said to be Metzler if its off-diagonal 
entries are nonnegative. The spectral abscissa of a square 
matrix A, denoted by r/(A), is defined as the maximum real 
part of its eigenvalues. We say that A is Hurwitz stable if 
t){A) < 0. Also, we define the matrix measure (40) of A by 
p(A) = rj(A + A J )/2. For a square random matrix X, its 
expectation is denoted by E[X] and its variance is defined 
by Var(X) = E[(X — ifjX]) 2 ]. The diagonal matrix with 
diagonal elements a\,... ,a n is denoted by diag(oi,..., a n ). 

A directed graph is defined as thepair Q = (V. £), where 
V = {vi, ... ,v n } is a set of node^Jand £ C V x V is a 
set of directed edges (also called diedges or arcs), defined as 
ordered pairs of nodes. By convention, we say that ( Vj,Vi ) is 
a directed edge from Vj pointing towards v %. The adjacency 
matrix A = [aif\ of a directed graph Q is defined as the 
n x n matrix such that a^- = 1 if (vj, vi) £ £ , and aij = 0 
otherwise. 

A stochastic process er taking values in a set F is said to 
be an aggregated Markov process (see, e.g., (36) ) if there exists 
a time-homogeneous Markov process 6 taking values in a 
set A and a function /: A —> T such that a = f (9). Through¬ 
out the paper, it is assumed that A is finite, / is surjective, 
and all the Markov processes are time-homogeneous. We 
say that a Markov process 6 is irreducible if all the states 
in A can be reached from any other state in A (see, e.g., 
ID for more details). We say that an aggregated Markov 
process cr = f(6) is irreducible if 9 is irreducible. We will use 
the next lemma in our proofs. 

Lemma 2.1 (©). Let 9 be an irreducible Markov process 

taking values in a finite set A. Then, 9 has a unique 

stationary distribution tv. Moreover, 

7t(A) = lim Pr (9(t) = A), 

£—>■00 

for every A £ A and 0(0) £ A. 

2.2 Spreading Process over Static Networks 

In this subsection, we review a model of spreading processes 
over static networks called the Heterogeneous Networked SIS 
(HeNeSIS) model, which is an extension of the popular 
iV-intertwined SIS model (?) to the case of nodes with 
heterogeneous rates. This model can be described using 
a continuous-time Markov process, as follows. Let Q be 
a directed graph, where nodes in Q represent individuals 
and diedges represent interactions between them (which we 
consider to be directed). At a given time t > 0, each node 
can be in one of two possible states: susceptible or infected. 
We define the variable Xi(t) as Xi(t) = 1 if node i is 
infected at time t, and X, (t) = 0 if i is susceptible. In the 
HeNeSIS model, when a node i is infected, it can randomly 
transition to the susceptible state according to a Poisson 
process with rate Si > 0, called the recovery rate of node i. 


1. For simplicity in notation, we sometimes refer to node v-i as i. 
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On the other hand, if node i is in the susceptible state, it 
can randomly transition to the infected state according to a 
Poisson process with rate /3, =1 a ijXj(t), where fa > 0 

is called the infection rate of node i. In other words, the 
rate of transition of node i from susceptible to infected is 
proportional to the number of its infected neighbors. 

Since the above Markov process has a total of 2" possible 
states (two states per node), its analysis is very hard for 
arbitrary contact networks of large size. A popular approach 
to simplify the analysis of this type of Markov process is 
to consider upper-bounding linear models. Let A denote 
the adjacency matrix of Q, and define p = (p±,... ,p n ) T , 
P = diag(pi,... ,p n ), B = diag(/3i,... ,/3„), and D = 
diag(<5i,..., S n ). Then, it is known that the solutions Pi{t) 
(i = 1, ..., n) of the linear differential equation 

p=(BA- D)p (1) 

upper-bounds the evolution of E[Xi(t)\ (i = 1, ..., n) from 
the exact Markov process with 2™ states |9|. Thus, if the 
dynamics in |[l} is globally exponentially stable, the infection 
dies out exponentially fast in the exact Markov process [6|, 
(l3|. In the case of homogeneous infection and recovery 
rates, i.e., /3i = /3 and Si = S for all i, the dynamics ([T| 
is globally exponentially stable if and only if 191 


Apart from the continuous-time Markov process de¬ 
scribed above, we can also model the dynamics of a spread 
using a discrete-time networked Markov chain with an 
exponential number of states |8|. As in the continuous¬ 
time case, we can show (8) that the solution of the linear 
difference equation 

p{k + 1) = {BA + I — D)p(k), (3) 

where p = (pi,... ,p n ) T , upper-bounds the probabili¬ 
ties Pr(i is infected at time k) (i = 1, ..., n). As in the 
continuous-time case, it turns out that if the discrete-time 
linear system in 0 is globally exponentially stable, the 
infection dies out exponentially fast in the exact Markov 
process |6|. In the case of homogeneous infection and re¬ 
covery rates, the system in {3]l is stable if and only if § 
holds 181. 

2.3 Aggregated-Markovian Random Graph Processes 

In this subsection, we introduce two new models of TV 
networks: the aggregated-Markovian edge-independent (AMEI) 
and the aggregated-Markovian arc-independent (AMAI) mod¬ 
els. As we mentioned above, these models generalize the 
class of edge-Markovian time-varying networks (27). Let 
G = {G{t)}t >o be a stochastic graph process taking values 
in the set of directed graphs with n nodes. Let A(t') denote 
the adjacency matrix of G{t) for each t > 0. The class of 
dynamic random graphs studied in this paper is defined as 
follows. 

Definition 2.2. Consider a collection of aggregated Markov 
processes <Ty = gij{0ij ) where gtj are {0,1}-valued 
functions and 0y are stochastically independent Markov 
processes for 1 < i < j < n. An aggregated-Markovian 



Fig. 1. A Markov process described in Example |23| 

edge-independent (AMEI) network is a random graph pro¬ 
cess in which Ay = A lt = Oij for i < j and An = 0 for 
all i £ [n). If Oij is irreducible for all possible pairs ( i,j ), 
then we say that Q is irreducible. 

In other words, the upper-triangular entries of the time- 
varying adjacency matrix A(t) of an AMEI graph are in¬ 
dependent aggregated Markov processes. The lower trian¬ 
gular entries are constructed via symmetry and the diag¬ 
onal entries are zero. Hence, the graph is undirected by 
construction and does not contain self-loops. AMEI graphs 
extend the class of edge-Markovian graphs (27) and allow 
us to model a wider class of edge processes. For exam¬ 
ple, in an edge-Markovian graph, the time it takes for an 
edge to switch from connected to disconnected (or vice 
versa) follows an exponential distribution. In contrast, in 
an AMEI graph, we can design the function g, :) and the 
Markov process 6 l: j to fit any desired distribution for the 
contact durations with arbitrary precision, as illustrated in 
the following example: 

Example 2.3. Let 9 be the Markov process over the state 
space S = {ci,..., Cn, di,..., d m } presenting the state- 
transition diagram shown in Fig. [l] Consider an edge 
modeled by the aggregated Markov process a = f(9), 
where the function f: S {0,1} is defined by fief) = 1 
and f{dj) = 0 for all i £ [n] and j £ [to]. Therefore, 
the edge is active if and only if 6 is in one of the states 
ci, ..., c n . From the diagram in Fig. [l] we see that the 
edge is active from the time 9 enters ci until the time 
6 arrives to d\. It can be proved that the time elapsed 
between these two events follows a Coxian probability 
distribution, which forms a dense subset in the set of 
nonnegative random variables m. Therefore, by appro¬ 
priately choosing the transition rates p\, ..., p n - i, qi, 
..., q„, it is possible to tune the distribution followed 
by the time the edge is active in order to follow any 
distribution with an arbitrary accuracy (when n is large 
enough). From the symmetry of the diagram in Fig. [lj 
we can also tune the parameters n, ..., r m _i, si, ..., 
s m so that the time the edge is inactive follows any given 
probability distribution with an arbitrary accuracy. 

In the following definition, we introduce a directed 
version of AMEI graphs. 

Definition 2.4. Consider a collection of aggregated Markov 
processes a t j = gij{0ij) where g t j are {0,1}-valued 
functions and 9ij are stochastically independent Markov 
processes for i,j £ [n] and i ^ j. An aggregated- 
Markovian arc-independent (AMAI) network is a random 
graph process in which Ay = cr,; 7 for i j and An = 0 
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for all i £ [n]. If ayy is irreducible for all possible 
pairs ( i,j), then we say that Q is irreducible. 

Once the class of aggregated-Markovian networks is 
introduced, we analyze spreading processes taking on these 
random graph processes. 


2.4 Problem Statement 

In this paper, we address the following question: Under what 
conditions does a spreading process taking place in a TV network 
with aggregated-Markovian link dynamics die out exponentially 
fast ? In other words, we consider the problem of analyzing 
the stability of the upper-bounding linear model ([lj when 
the graph is an aggregated-Markovian network. In this case, 
the entries of the adjacency matrix are random processes 
and, therefore, is the following stochastic linear differen¬ 
tial equation: 


E :p(t) = ( BA(t ) - D)p(t ), 


where A(t) is a random matrix process. In the following 
section, we will derive conditions under which the disease- 
free equilibrium of E is stable, i.e., the infection probabilities 
converge to zero as t —> oo exponentially fast, in the 
following sense: 

Definition 2.5. Consider a random graph process Q defined 
by either an AMEI or AMAI graph. We say that the 
disease-free equilibrium of E is almost surely exponentially 
stable if there exists A > 0 such that 


Pr 


( limsup 

\ t—> OO 


ioglb(*)ll 

t 


< -A 


= 1 , 


for all initial states p{ 0) = po and ( 7 ^( 0 ) = er,; ? .o. The 
supremum of A satisfying the above condition is called 
the decay rate. 


3 Stability of Spreading Processes in Ran¬ 
dom Graph Processes 


In this section, we state the main results in this paper. In 
particular, we derive conditions for the spreading model E 
to be stable when the network structure varies according 
to an AMEI (or AMAI) random graph process. In Subsec- 

based on the 


3.1 we apply a stability condition 


tion 

direct application of the Ito formula for jump processes to 
derive stability conditions in terms of the largest eigenvalue 
of a matrix whose size depends exponentially on the num¬ 
ber of edges in the graph. Due to the exponential size of 
this matrix, this condition is hard (if not impossible) to 
apply in the analysis of large-scale networks. Motivated by 
this limitation, we propose in Subsection 3.2 an alternative 
approach using tools from the theory of random matrices. 
In particular, we derive stability conditions in terms of the 
largest eigenvalue of a matrix whose size depends linearly 
on the number of nodes. In Subsection |3.3| we extend our re¬ 
sults from continuous-time Markov processes to spreading 
processes modeled as discrete-time Markov chains. 


3.1 Stability Conditions: Exponential Matrix Size 

In this subsection, we show that the result in |37| Theo¬ 
rem 7.1] based on the direct application of the Ito formula 
for jump processes results in stability conditions that are 
not well-suited for large-scale graphs. We illustrate this idea 
through the analysis of the stability of the spread when 
Q is an AMAI random graph process. For simplicity in 
our exposition, we here temporarily assume that all the 
processes o V) are Markovian; i.e., the mappings g,j are the 
identities. 

To state our claims, we need to introduce the follow¬ 
ing notations. Let Q be an AMAI random graph process 
(Definition |2 A\ . Let £ be the set of (time-varying) directed 
edges in Q (i.e., those directed edges such that a l3 is not 
the zero stochastic process). Let m = |£| be the number of 
diedges in Q and label the diedges using integers 1 ,,m. 
Recall that these edges are not always present in the graph, 
but they appear (link is 'on') and disappear (link is 'off') 
according to a collection of aggregated-Markov processes. 
Therefore, at a particular time instant, only a subset of the 
edges in £ are present in the graph. The set of present edges 
can be represented by an element of { 0 , 1 } m , since we have 
m possible edges that can be either 'on' of 'off'. In other 
words, at a particular time, the contact network is one of the 
2 m possible subgraphs of Q. 

To analyze the resulting dynamics, we consider the 
set of 2 m possible subgraphs of Q and label them using 
integers {l,...,2 m }. We define the one-to-one function 
X- {l,...,2 m } —t {0, l} m , as the function that maps a 
particular subgraph of Q into the binary string in { 0 , l} m 
that indicates the subset of present edges in the subgraph. 
For the subgraph labeled £, we denote by xe the corre¬ 
sponding binary sequence and by %^(/c) the k-ih entry in 
this sequence. In other words, Xt{k) = 1 means that the 
edge labeled k in Q is present in the subgraph labeled i. 
Furthermore, we denote by Fn £ {0, l} nxra the adjacency 
matrix representing the structure of the subgraph labeled L 

Given two labels £, £' £ [2 m ], define the edit dis¬ 
tance d(£, £') to be the minimum number of links that 
must be added and/or removed from the subgraph 
labeled i to construct the subgraph labeled £', i.e., 
d{l,l') = \{k £ [m]: xt(k) yt xr(k)}\. If = 1 (i.e., 

the subgraphs differ in a single diedge), we define k^j/ as 
the (only) index k such that x<?(fc) 7 ^ Xt'(k) (i.e., the label of 
the single edge that must added/removed). Finally, assume 
that the transition probabilities of the Markov process a l:) 
(( i,j ) £ £) are given by 

Pr(u ij(t + h) = 1 | = 0) = Uijh + o(h), 

Pr(oij(t + h) = 0 | <Jij(t ) = 1) = Vi jh + o(h), 

for some nonnegative constants Uij and Vjj . We define 
u(k) = Ui k j k and v(k) = Vi k j k for each k £ [m]. 

Under the above notations, the following stability condi¬ 
tion readily follows from (37] Theorem 7.1]: 

Proposition 3.1. Let Q be an AMAI random graph process. 

Define II £ R 2 x2 entry-wise, as follows. For £ £', 

! u{ki,t'), if d(xe,xc) = 1 and xe{ke,e>) = 0 , 
v(ke,e>), if d(xi,Xt') = 1 and Xt(h,t') = 1, 

0 , otherwise. 
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For £ = £!, we let II« = — II w- Then, for every i, 

the probability that i is infected at time t in the HeNeSIS 
model converges to zero exponentially fast as t —t oo if 
the ( n2 m ) x (n2 m ) matrix 

2 m 

n + (4) 

1=1 

where (g) denotes the Kronecker product of matrices, is 
Hurwitz stable. 

As stated before, this stability condition is not applicable 
to large-scale networks, since it requires the computation of 
the eigenvalue with the largest real part of a matrix whose 
size increases exponentially with the number of edges in the 
graph Q. In the following subsection, we present alternative 
stability conditions that are better-suited for stability analy¬ 
sis of large networks. 


3.2 Stability Analysis: Linear Matrix Size 

In this subsection, we present sufficient conditions for al¬ 
most sure exponential stability of the disease-free equilib¬ 
rium of E when the underlying time-varying network is 
described by an AMEI (or AMAI) random graph process. 
For clarity in our exposition, we state and discuss our main 
results in this section, leaving the details of the proofs for 
Subsections 15.II and 15.21 

We now state our main results. Let us consider two pos¬ 
itive constants b and d, and define the decreasing function 

n bid : [0, oo) -)• (0, n] by 

Hb,d( s ) = neS/b > ( 5 ) 


where n is the number of the nodes in the network. The fol¬ 
lowing theorem provides conditions for a spreading process 
taking place in an AMAI random graph process to be almost 
surely exponentially stable. 

Theorem 3.2. Let Q be an irreducible AMAI random graph 
process and define A £ R" xrl component-wise, as fol¬ 
lows 

Aij = lim Pr(A y (f) = 1). (6) 


Let /3 = maxi<i< n ft, 5 = mini<j< n ft, and 

n 

Ai = max (ft Aij( 1 — ) + (3jAji(\ — Aji)) , 

Ki<n J 

~ ~ .1 ‘I 

(!) 

ci = n(B(sgn A) — D) -—, 

si = 25 2c 1 . 


Define 


ta = maximize 

Se ( K ^A 1 ( 1 )’ 51 ] 

S + 2Ci« / 3 Ai ( s ) \ 

v 2(! - k p,Ai ( s ))J' 

(7) 

n{BA- 

D ) < t a , 

(8) 


then the disease-free equilibrium of E is almost surely 
exponentially stable with a decay rate greater than or 
equal to 

-KBA -£>)(!- K 0 Al (s*)) - («7 2 ) - ci^ Al (s*), 


where s* denotes the optimal value of s in the maximiza¬ 
tion problem 0- 


Proof: See Subsection 5.1 


□ 


Remark 3.3. The existence of the limit in 0 is guaran¬ 
teed by the irreducibility of Q as will be discussed 
in Subsection 5.1 where we will also give an explicit 
representation of the limit. 


The major computational cost for checking the stability 
condition in § comes from that of finding the matrix 
measure /i(f?A — D). Since the matrix BA — D has size n, 
we can compute /x(i?A — D) in 0(nm 2 ) operations using 
Lanczos's algorithm |43| , where n and m are the number of 
nodes and diedges in Q. In contrast, computing the dom¬ 
inant eigenvalue of the n2 m -dimensional matrix in 0 re¬ 
quires 0(nm 2 2 m ) operations, since this matrix has 0(m2 m ) 
nonzero entries. Therefore, the result in Theorem |3.2| (based 
on random graph-theoretical results) represents a major 
computational improvement with respect to the result in 
Proposition |3.1| (based on a direct application of the Ito 
formula for jump processes (37)). 

Above, we have analyzed the stability of spread¬ 
ing processes in aggregated-Markovian arc-independent 
(AMAI) networks. In the rest of the subsection, we derive 
stability conditions for spreading processes taking place 
in aggregated-Markovian edge-independent (AMEI) net¬ 
works. The next theorem is the AMEI counterpart of The¬ 
orem |3A] 

Theorem 3.4. Let Q be an irreducible AMEI random graph 
process. Let 


A 2 = max (PA A ij ( 1 - A A) > 

1 <i<n — 

“ “ i=i 

c 2 = r)(B(sgn A) - D) - 
s 2 = 5 + cf. 


Define 


te 


maximize 

Se ( K J,A 2 ( 1 )-* 2 ] 


( s + c 2^,A 2 ( S ) N \ 

V !- K AA 2 ( s ) / 


If 


r](BA - D) < t e , 


(9) 


( 10 ) 

( 11 ) 


then the disease-free equilibrium of E is almost surely 
exponentially stable with a decay rate greater than or 
equal to 

- ri(BA -D)(l- Kp A2 (s*)) - s* - c 2 Kp A2 (s*), (12) 


where s* denotes the optimal value of s in the maximiza¬ 
tion problem (To). 


Proof: See Subsection 5.2 


□ 

Theorems 3.2 and |3.4| provide threshold conditions for 
stability of spreading processes in time-varying networks 
when agents present heterogeneous infection and recovery 
rates, ft and ft, respectively. In the particular case of net¬ 
works with homogeneous rates, i.e., ft = (3 and ft = 5 
for all i, our results have an appealing interpretation that 
can be related with existing results in the literature. The 
following theorem states a threshold stability condition in 
the homogeneous case: 
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Theorem 3.5. Let Q be an irreducible AMEI random graph 
process. Assume that /3j = (3 > 0 and <5, = 8 > 0 for all 
i £ [n]. Let 


A 3 = max ^ (Aj( 1 - Aj)) , 

Ki<n — 

“ - i=i 

c 3 = ?7(sgn A) - k^ 3 ( 1 ), 

(5 

s 3 = j 3 + c 3 . 


Define 


^ . . 1 - (/3/<5) (s + c 3 ki,a 3 (s)) 

E,h = maximize ----. 

se ( K i“ 1 A 3 ( 1 )>53] 1 - «i,A 3 (s) 


(13) 


(14) 


If 

(3 in 

8 77(A)’ 


(15) 


then the disease-free equilibrium of E is almost surely 
exponentially stable with decay rate greater than or 
equal to 


(<V/3) - 77 (A) - S* - (c 3 - A 3 )Ki,A 3 (s*), 


where s* denotes the optimal value of s in the optimiza¬ 
tion problem Moreover, if 


S 7 y(sgn A)’ 


(16) 


then £ h < 1 - 


Proof: See Subsection 5.2 


□ 


Remark 3.6. Since A(t) < sgnA entry-wise for every 
t > 0, the solution of E is always upper-bounded 
by that of the deterministic differential equation 
p(t) = (/ 3 sgnA — 5I)p(t), whose solution converges to 
zero as t — t 00 if and only if j3/8 < l/?7(sgn A). There¬ 
fore, if the inequality ( [l 6 l > is false, then the disease-free 
equilibrium of E is almost surely exponentially stable 
and, hence, we do not need to check condition fj~5) . 
In other words, condition ( [16} guarantees that stability 
analysis of E is not a trivial problem. 


As shown in Subsection |2.2[ the epidemic threshold in a 
static network of agents with homogeneous rates is given by 
/3/S < 1 / 77 (A). Condition (ED provides a similar epidemic 
threshold for time-varying networks in terms of the spectral 
abscissa of A, which can be interpreted as an aggregated 
static network based on long-time averages. Furthermore, 
l ;h is a multiplicative factor that modifies the epidemic 
threshold corresponding to the aggregated static network. 
Below, we derive explicit expressions of 77(A) for a few 
particular examples of time-varying graph models found in 
the literature: 


Example 3.7 (Dynamic small-ivorld networks). We con¬ 
sider a time-varying version of the small-world network 
model studied in (44). The network consists of n nodes 
and n static edges in the set £ 0 = {( 1 , 2 ), ( 2 ,3),..., (n — 
lj n )i ( n > !)} ( see Fi g- §■ Apart from these static edges, 
we also consider a collection of dynamic edges that 
switch on and off over time. In particular, we allow 
any other pair of nodes (i. j) ^ £q (i A j) to be 



Fig. 2. Dynamic small-world network. Solid lines represent static edges, 
while dashed lines represent temporarily active edges modeled by 
aggregated-Markov processes. 


dynamically connected according to an irreducible ag¬ 
gregated Markov process a,, = r/,; ;; (0,; ? ). For simplicity 
in our analysis, we assume that the stationary proba¬ 
bility of an edge (i, j) ^ £q being active, defined by 
r,j = lim^oo Pr(ajj(f) = 1 ), equals a constant r > 0 
independent of i and j. In this case, the matrix A takes 
the form 

( 0 , if i = j, 

Aj = < 1 , if e A, 

I r, otherwise. 

The spectral abscissa of A is given by 1 +r(n — 2 ). There¬ 
fore, the stability condition fj~5) reads (3/5 < £,h/( 1 + 
r(n — 2)). 


Example 3.8 (Edge-Markovian graph). In this example, we 
consider the edge-Markovian graph model proposed 
in l |27) . In this model, all the undirected edges (i,j) 
(i < j) are time-varying and modeled by independent 
{0, l}-valued Markov processes Oij sharing the same 
activation rate q > 0 and de-activation rate r > 0. In 
this case, we have 


Aj — 


0 , 

q/(q + r), 


if i = j, 
otherwise, 


and therefore 77 (A) = (n — 1 )q/{q + r). The stability 

condition ffs) hence reads (3/8 < fn(q + r)/((n — l)q). 

In what follows, we elaborate on the behavior of the 
factor £#. In particular, we will analyze its dependence on 
A 3 defined in |~i~3) . Notice that A 3 is zero when A , :) is either 
0 or 1 for all pairs ( i,j ), which corresponds to the case of 
a static, deterministic graph Q. In contrast, the maximum 
value of A 3 is achieved when A, :) = 1/2, i.e., edges are 
either 'on' or 'off' with equal probability (asymptotically). 
Therefore, the term A 3 can be interpreted as a measure 
of structural variability, in the long run. In Fig. [3] we 
illustrate the behavior of the factor £# as we modify the 
network size n, the epidemic ratio 8/(3, and the uncertainty 
measure A 3 . We observe that the smaller the value of A 3 , 
the larger the value of (/h- In other words, as we reduce 
the structural variability (i.e., we reduce A 3 ), we obtain a 
better approximation using an aggregated static model (i.e., 
(;h approaches 1). Furthermore, notice that the value of (/h 
tends to 1 as n increases. This indicates that the aggregated 
static network approximates the epidemic threshold more 
accurately as the network grows. 






7 



In this section, we have introduced our main theoretical 
results, namely, we have studied the epidemic threshold in 
the wide class of aggregated-Markovian random graph pro¬ 
cesses. Before we illustrate our results with some numerical 
simulations in Section |4j we will discuss the case when the 
epidemics is modeled as a discrete-time stochastic process. 


3.3 Discrete-Time Epidemic Dynamics 


Theorem 3.10. Consider an irreducible and aperiodic]^ AMEI 
random graph process Q in discrete-time. Let A 4 = 
t,(BA + I — D) and M max = B(sgn A) + I — D. Define 


td = maximize 

0<s<1-A 4 


a 4 


where A 2 is defined in (9|. If 

A 4 < td, 


^/3,A 2 


0 ) 


(17) 


(18) 


In this subsection, we briefly present a discrete-time ver¬ 
sion of the stability analysis provided above. We define a 
discrete-time dynamic random graph as a stochastic pro¬ 
cess G = {G(k)}^ =0 taking values in the set of directed 
graphs with n nodes. In the discrete-time case, aggregated- 
Markovian edge- and arc-independent dynamic random 
graphs are defined in the same way as in the continuous¬ 
time case. Let us consider the discrete-time epidemic model 
in 0 taking place in the dynamics random graph Q. The 
resulting dynamics is described in the following stochastic 
difference equation: 

£ d : p{k + 1) = ( BA(k) + I - D)p(k), 

where A(k) denotes the adjacency matrix of G{k). 

We define almost sure exponential stability of the 
disease-free equilibrium of E,/ in the same way as we did 
for the continuous-time case: 


then the disease-free equilibrium of E<f is almost surely 
exponentially stable with decay rate greater than or 
equal to 

7 d = - log(A 4 + S*) - Kp Ao ( s *) log ; ( 19 ) 


where s* denotes the value of s giving the solution to 
the optimization problem fl7). 


Proof: See Subsection 5.3 


□ 


4 Numerical Simulations 

In this section, we illustrate the effectiveness of our results 
with numerical simulations. In our illustrations, we consider 
a discrete-time edge-independent dynamic random graph Q 
with n nodes. This random graph process is specified by the 
two following rules: 


Definition 3.9. Let G be a discrete-time edge-independent 
dynamic random graph. We say that the disease-free 
equilibrium of is almost surely exponentially stable if 
there exists A > 0 such that 


Pr(limsup l 0 Sll ; (t)ll <-Al=l 

\ k —> 00 & 


for all p(0) = p 0 G [0, l] n and cr, ; (0) = < 7 y - j0 (1 < i < 
j < n). We call the supremum of A satisfying the above 
condition the decay rate. 


For simplicity in our exposition, we focus only on the 
edge-independent case (AMEI graph process), since the 
analysis is identical for the arc-independent case. The next 
theorem provides a sufficient condition for almost sure 
exponential stability of the disease-free equilibrium of E,/. 


1) Construct an undirected Erdos-Renyi random graph 
over the nodes of G (45] ■ Denote the resulting n x n 
adjacency matrix by A. 

2 ) If Aij = 1 , then nodes i and j are connected in G 
via a stochastic link described by a { 0 , 1 }-valued 
time-homogeneous Markov chain a l;l . The transi¬ 
tion probability from 0 to 1 in this Markov process 
is given by > 0 ; while the transition probability 
from 1 to 0 is given by r ,; 7 > 0. If A^ = 0, then 
nodes i and j are not connected in G at any time. 

One can easily deduce that, according to the second rule, 
Aij = Aji = qij/{rij + qij) if A = 1. In the following 
simulations, we let n = 500 and consider a realization of an 

2. We say that an AMEI random graph process in discrete-time is 
aperiodic if all the aggregated Markov processes in the adjacency matrix 
of the graph are the images of aperiodic Markov chains. 
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Fig. 6 . Sample paths of the number of infected nodes for different values of 0. 


the Erdos-Renyi graph with an edge probability of 0.2 (in 
step 1 above). The values of the transition probabilities 77 ,- 
(in step 2 above) are heterogeneous over the links of the 
Erdos-Renyi graph. In particular, we have chosen for 777 a 
collection of random values from the Gaussian A/"(l/2,1/8), 
where we have truncated those values r, 3 > 1 to r l3 = 1 , 
and rij < 0 to 77 ,- = 0. Finally, we let q, 3 = 1 — 777 . 


We consider a discrete-time spreading process with ho¬ 
mogeneous infection and recovery rates, i.e., 3, = /3 and 
Si = 0.05 for all i. Using Theorem 3.10| we deduce that the 
disease-free equilibrium of Y.,i is almost surely exponentially 
stable if (3 < 6.32 x 10~ 4 . The upper bound 773 of the 
decay rate versus /3 is shown in Fig. [4] In order to check 
the accuracy of this epidemic threshold, we compare this 
threshold with the one obtained from the following simula¬ 
tion. We simulate the spreading process over the dynamic 
random graph described above for various values of (3. 
For each value of 0, we generate 500 sample paths of the 
spreading process. In this simulation, we prevent a spread¬ 
ing process from dying out by re-infecting a randomly 
chosen node immediately after the infection process dies 
(i.e., when all the nodes become susceptible). A similar re¬ 
infection mechanism is employed for simulating spreading 
processes over static networks (46) . After the simulation, we 
compute the averaged number of infected nodes y* at time 
k = 1.000. This is the meta-stable number of infected nodes 
when re-infection of nodes is allowed. We then determine 
the metastable number of infected nodes in the original 


spreading process without reinfection as z* = y* — 1 , where 
the subtraction of one compensates the effect of re-infection. 
Finally, we define the empirical epidemic threshold 0* as 
the maximum value of 0 such that z* < 1 . 

Fig. [5] shows the value of z* as (3 varies. We see that 
the above defined empirical threshold f3* lies between 
7.2 x 10 4 and 7.5 x 10 4 , confirming that our condition 
indeed gives a sufficient condition for stability. On the other 
hand, the epidemic threshold based on the aggregated static 
network A (i.e., the supremum of (3 such that (3/5 < 1 / 77 (A)) 
is 9.95 x 10 “ 4 and, therefore, overestimates the actual epi¬ 
demic threshold. In Fig. [ 6 j we show multiple realizations of 
the sample paths used to obtain Fig. |5] for [3 = 6.0 x 10~ 4 , 
7.5 x 10~ 4 , and 9.0 x 10" 4 . 

5 Proofs of Main Results 

This section presents the proofs of the theorems presented 
in Section [3] 

5.1 Proof of Theorem I 3 T 2 I 

We begin by recalling a basic result on the stability analysis 
of a class of stochastic differential equations called switched 
linear systems. Let a = f{6) be an aggregated Markov 
process defined by the mapping /: A —► F and a Markov 
process 6 with state space A. For each 7 £ T, there is an 
associated state matrix A 1 £ R" xn . An aggregated Markov 
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jump linear system is defined by the following stochastic 
differential equation 

x(t) = A f(e{t)) x(t), ( 20 ) 

where x(0) = Xq £ M n and 0(0) = € A. We remark 

that, if / is the identity mapping, then the system in l [ 20 ) is 
a Markov jump linear system | |47) . We say that the system 
in j 2 (j) is almost surely exponentially stable if there exists A > 0 
such that Pr(limsup t _ > , 00 t~ l log||x(f)|| < —A) = 1 for all xq 
and 0q. The sup remum of A satisfying the above condition 
is called the decay rate. In order to prove Theorem 3.2 we 


Mi — —D + ^2 ^2 Pih 


ij Eij , 


i=i jjti 


F 1 — ^2 ^2 To' E-i j ■ 

i=l j^i 


2.4 


Then, from Definition 

Tjj (t)Ejj = P'cr(t) 




= F; 


mt)) 


of 6 is 7 r = i 


yi=l 


7 Tij. Therefore, by Lemma 5.1 if 


E[p(BFf^ — D)\ < 0, then £i = £ is almost surely 
exponentially stable with decay rate greater than or equal 
to —E[p{BFf^) — D)]. Therefore, to complete the proof of 
the proposition, we need to show that 


BF 


/M 


— D = Mi, 


(24) 


in the sense that the random matrices appearing in the both 
sides of the equation share the same probability distribution. 
From ([23} and the definition of the matrix B, we have 


will need the following criterion for almost sure exponential 
stability of aggregated Markov jump linear systems. 

Lemma 5.1. Assume that 9 is an irreducible Markov process 
and let tt be its unique stationary distribution. Assume 
that 

E [p(A fM )] < 0. (21) 

Then, the aggregated Markov jump linear system in |20) 
is almost surely exponentially stable with a decay rate 
greater than or equal to ~E\p(Af^)). 

Proof: The above statement is known to be true for 
Markov jump linear systems (48| Theorem 4.2], i.e., when / 
is the identity mapping. Let us now consider an arbitrary 
function /. Define B\ = A1/(a) for each A £ A. Then, we 
see that the system in l [20) is equivalent to the Markov jump 
linear system x(t) = B g ^x(t), for which we can guarantee 
almost sure exponential stability with decay rate grater than 
or equal to — E\p(B^)\ > 0 via the condition E\p(B n )\ < 0 
|48] Theorem 4.2]. This condition is equivalent to pT) by the 
definition of B\. ]QE 


BF fM - D = -D + Y.Y. PifiiMEij. 

i=l j^H 


(25) 


Since /, i7 maps into {0,1}, the random variable f t j ( 7 r,; 7 -) is 
the Bernoulli random variable with mean equal to 

= 1) = 7T*j (/ i 7 1 ({ 1})) 

= Pr (%W e/^({i})) 

= lim Prjcr.Mi) = 1) 

t —^OO 

— A. . 


where we used Lemma |2.1| Moreover, all the random vari¬ 
ables fij (7 T^) ( i,j £ [n], i 7 ^ j) are independent of each other 
because Q is arc-independent. From these observations and 
the equation (|25), we obtain ([24), as desired. □ 


In order to complete the proof of Theorem 3.2 we need 


Using Lemma 5.1 we can prove the following prelimi¬ 
nary result, which will be useful in the proof of Theorem |3. 2 [ 
Proposition 5.2. Consider an irreducible AMAI random 
graph process Q. For all distinct and ordered pairs 
(i, j) £ [n] 2 , let hij be an independent Bernoulli random 
variable with mean A, , . Define the random matrix 


( 22 ) 


where Eij denotes the { 0 , 1 }-matrix whose entries are 
all zero except its (z,_))-entry. If E\p(Mi)] < 0, then, 
the infection-free equilibrium of £ is almost surely ex¬ 
ponentially stable with decay rate greater than or equal 
to -E\p(Mi)]. 

Proof: Define the direct product 9 = &”=i 
which is a stochastic process with state space A = 
< 8 >?=i Air Define / : A —► {0, l}^" 1 ) by (fW)ij = 
fij(Xij). Also, for 7 = (7 ij)ij £ {0, l}” (n_1) , define the 
matrix 


the following result from the theory of random graphs 
concerning the maximum eigenvalue of the sum of random 
symmetric matrices. 

Proposition 5.3 (p9}). Let X u ..., X N be independent ran¬ 
dom n x n symmetric matrices. Let C be a nonnegative 
constant such that \\Xk — i?[Afc]|| < C for every k £ [N] 
with probability one. Also let v 2 = ||EfeLi Var(Xfc)||. 
Then the sum X = EaLi satisfies 

Pr ( V (X) > V(E[X]) + s) < k c , v i(s) (26) 
for every s > 0 (where Kty(s) was defined in {5}). 

Proof: Let s > 0 be arbitrary. Under the assumptions 


V 


(23) 


we see that A(t) = 
Therefore, we can 


rewrite £ as the aggregated Markov jump linear system 
£1 : p(t) = {BF f(e(t)) - D)p(t). 

By the irreducibility of Q, each time-homogeneous 
Markov process has a unique stationary distribu¬ 
tion 7 on A ij. Then, the unique stationary distribution 


stated in the proposition, it is shown in |49) that, for every 

9 > 0 , 

Pr (r](X) > rj(E[X}) + s) < n exp 9s + ^ g{C9)9 

where g is defined by g{x) = 2 x~ 2 (e x — x — 1) for 
x > 0. It is easy to show that the right hand side of the 
inequality takes its minimum value with respect to 9 when 
9 = (l/C)log(l + ( Cs/v 2 )). Substituting this particular 
value of 9 into the inequality, we readily obtain ((26) . p. 

In order to complete the proof of Theorem |3.2[ we also 
need the next lemma concerning Metzler matrices. 

Lemma 5.4 (@ Lemma 2]). Let A and B be Metzler 
matrices. If A < B, then we have 17 (A) < 17 (B) and 
p(A) < p(B). 

We can now provide a proof of Theorem|3.21 


Proof of Theorem 3.2 Let Ai = p(BA — D) and define 


X = Mi + Mj - 2Ai I - Ai ( 1)A Notice that 

g(E(X]) = -«^ Ai (l), 


( 27 ) 
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because g{E[M i + Mj]) = 2p(E[M 1 }) = 2/i(B4 - D) = 
2Ai by @. Also, from the definition of A/) in |22) , we have 

n 

X = (—2ArJ- 2D - «^ Ai (l)/) + ££ 

i=i j^i 


where X t j = 8i(Eij + Ejffhij ( i,j £ [n] and i ^ j) 

are random, independent symmetric matrices. We then ap- 
to the random matrix X, for which 
Clearly, the first constant term of X 


ply Proposition 5.3 
we choose C = 8. 


has zero variance, while a simple computation shows that 

Var (Xij) = 8?Aij( 1 - A ij )(E ii + Ejj). Therefore 


v 2 = 


Y. Y. - A i j){E ii + Ejj ) 

<=i 


y PjAijO- - Aij) + “ Aji) 

, = 1 


(28) 


Combining ( |26) , ( [27} , and ([28}, we obtain the estimate 

p r (v{X) > + s) < Kp Al (s) (29) 

for s > *^ >Ai (l). 

Let (f), E. Pr) be the fundamental probability space and 
consider the set f2 s = {w £ fl: tj(X) > —k^ Ai ( 1) + s} 
for s > Al (l)- If w fl s , then r](X) < — k ¥ Ai ( 1) + s 
vacuously. On the other hand, if w £ f] s , then Lemma |5.4| 
gives the obvious estimate 


r?(X) < 2 p(f?(sgn A) - D) - 2Ar - /^(l) 
= 2ci — 2Ai 


because Mi < -D + Yn=\ = -B(sgnA) - D. 

Therefore, from [29} it follows that 

mx)\ 

<(-^ Al (l) + s) Pr(fi\n s ) + (2ci - 2Ai) Pr(fi s ) (30) 

— — + S + (2ci — 2Ai)re ( g jAl (s). 

By the definition of the random matrix X, this inequality 
implies that 


2E[/j(Mi)\ < 2Ai(l — k /3,Ai ( s )) + s + 2cik^ iAi (s). (31) 


Now we assume that condition 
rem holds. Then, there exists s* > n 


it 


in the theo- 
Ai(l) such that 
2 (l — Kp Al (s*)) Ai < —s* — 2ciKp Al (s*). Therefore, when 
s = s*, the inequality © yields that E[p(Mi)\ < Ai(l — 
K p,A 1 ( s *)) + ( s */2) + c i k /3,Ai( s *) < 0 and hence we can 
complete the proof of Theorem |3.2|by Proposition 5.2 □ 


Remark 5.5. The upper bound si of the interval in the 
maximization problem ([7} does not play any role in 
the proof of Theorem |32| In fact, the theorem holds 
true even if we replace the interval with the infinite 
interval [k^ Ai (1)> 00 ). The reason why we introduce the 
upper bound is that 1 ) it makes it easy for us to find 
the maximum and 2 ) it does not introduce conserva- 
tiveness. To prove the second statement, it is sufficient 
to show that the objective function in (7| is less than 
/ i(BA — D) if s > A (1) and s > si. From the 
former inequality, we obtain 0 < k(s) < 1. Also, notice 


the that from Lemma |5.4| there follows the inequality 
—6 = p(—D) < p(BA — D). Therefore, we can estimate 
the objective function as 


S + 2ciKg iAl (s) ^ S 

2(1 -k*a») <_ 2 


Cl^a.Ai(s) < 


- y + Ci =-5< p(BA - D), 


as desired. We can justify the upper bounds $2 and S 3 
in the maximization problems ( |To) and © in the same 
way. 


Remark 5.6. It can be easily verified that the proof of 
Theorem |3.2| still holds true even if we define Ci to 
be p(B(sgnA) — D). However, the inclusion of the 
term —k^^( 1)/2 into C\, as was done in the theorem, 
makes the maximum in condition | 8 } larger, and hence 
can reduce the conservativeness of this condition. 


5.2 Proof of Theorems l3.4l and l331 

In this subsection, we prove Theorems |3.4| and |3.5| for the 
edge-independent case in this subsection. We begin with the 
following analogue of Proposition |5.2| 

Proposition 5.7. Consider an irreducible AMEI random 
graph process Q. Let h, 3 (1 < i < j < n) be independent 
Bernoulli random variables with mean A, j. Define the 
random matrix 

n 

M 2 = -D + 8i8j{Eij + Eji)hij. 


2=1 j>i 


If 


E[v(M 2 )] < 0, 


(32) 


then, the disease-free equihbrium of E is almost surely 
exponentially stable with decay rate greater than or 
equal to — D[ry(M 2 )]. 

Proof: Define the direct product 9 = ®”=i %/ 

which is a Markov process having the state space A = 
<8>Li < S)j>i Aq- Also, define g: A -t {0, l}"!" -1 )/ 2 by 
(dW)ij = For 7 = ( 7 £ {0, l} n ( n_1 )/ 2 , define 

the matrix 


g 7 — y\ 7 ij +Eji). 


2=1 j>i 


Then, we can show that A = ^ ”=i J2j>i a ij(Ej 


G a = G g (e) by Definition 2.2 Moreover, g(6) is an aggre- 


(33) 


■ Ea) — 


gated Markov process, since f/ is a Markov process. Hence, 
we can rewrite E as the aggregated Markov jump linear 
system p(t) = (. BG g tg^ —D)p{t). The state transformation 
x i-t B~ 1 t 2 x, where D -1 / 2 = diag(/3j~ 1 ^ 2 ,..., 8 n 1 ^ 2 ), 
shows that almost sure exponential stability of this system 
is equivalent to almost sure exponential stability of the 
following aggregated Markov jump linear system: 


S 2 : p(t) = (B^Gg^B 1 ' 2 - D)p(t). 


To 

E 2 , 


prove almost 
by Lemma 


5.1 


E[ V (B^G gM B^ D)} 


sure exponential stability of 
it is sufficient to prove that 


< 0 , where we have used 
the fact that 77 (A) = p(A) for a symmetric matrix A. On 
the other hand, in the same way as we did in the proof 
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of Proposition |5.2( we can prove that random matrices 
B l / 2 G— D and M 2 have the same probability 
distribution. Therefore, condition f32) is sufficient to 
guarantee almost sure exponential stability of £ 2 and 
hence of £. Moreover, from the above argument, it is 
straightforward to see that the decay rate of the almost sure 
exponential stability is greater than or equal to —.E[t 7 (M 2 )]. 
This completes the proof of the proposition. tj 

Let us prove Theorem 3.4 


Proof of Theorem 


3.4 


Let A 2 = r](BA — D) and define 


x = m 2 — a 2 J - «^ Aa (i)/ 

n 

= (-a 2 J -d- k~^ 2 (1 )l) + ££ x ij} 

i —1 j>i 

where X tJ = ^/p i Pj(E i j + E r f)h ly We now apply Propo¬ 
sition |5.3| to the random matrix X, for which we choose 
C = (3. Also, in the same way as we derived |28], 


we can show 


= An. Since 


V(E[X]) = -k s 
.-1 


-l 


from |26) we obtain Pi'(? 7 (Al) > — ^'^(1) + s) < /c^ a 2 ( s )- 
Then, in the same way as we derived {30) , we can show 
E[y(X)\ < -«^a 2 (1) + s + ( c 2 -A 2 ) k ^,a 2 ( s ), which implies 
E[r)(M 2 )\ < A 2 (1 - 2 ( s )) + s + c 2 Kp A 2 (s). Using this 

inequality and Proposition |5.7| in the same way as we did in 
the proof of Theorem |3.2| we can show that condition fTT) in 
the theorem is indeed sufficient for almost sure exponential 
stability of the disease-free equilibrium of £ with decay rate 
greater than or equal to ©■ □ 


Finally, we give an outline of the proof of Theorem 3.5 
below. 


Proof of Theorem 3.5 Consider an irreducible AMEI 


random graph process Q. Assume homogeneous spreading 
and recovery rates, pi = j3 > 0 and 8 i = 8 > 0 for all 
i. In the same way as we did in the proofs of Proposi- 
we can show that if r}(E[M 3 \) < 


tions 5.2 


and 


5.7 


5.3 Proof of Theorem 13.101 

In this subsection, we give the proof of Theorem |3.10 for 


spreading processes running in discrete-time. In order to 
prove this theorem, we need to recall some facts regarding 
the stability of switched linear systems. Let a = f(9) be an 
aggregated Markov chain defined by the mapping /: A —> 
r and a Markov chain er with state space A. Let us define 


aggregated-Markov jump linear system is described by the 
stochastic difference equation 


x(k + l) = A f(g(k)) x, 


(34) 


_ 5/p 

for M 3 = i + Eji)hij, then the disease-free 

equilibrium of £ is almost surely exponentially stable with 
decay rate greater than or equal to (5/P) — rj(E[M 3 ]). Let 
A 3 = 77(A) and define X = M 3 — A 3 1 — Kj~A 3 (l). Applying 
Proposition |5 .3 1 to the random matrix X, we obtain 

E[V(X)] < -Kh.AaC 1 ) + S + ( C 3 - ^ 3 )«1,A 3 (s). 

Therefore, E[r] (M 3 )] < A 3 +s+(c 3 — A 3 )Ki,a 3 (s)- Using this 
inequality and the assumption (l5| l, we can actually show 
r](E[M 3 \) < 5/P and therefore the almost sure exponential 
stability of £ in the same way as the proofs of Theorems |3.2| 
and 13.41 We omit the details of the derivation of the lower 
bound fl9) of the decay rate. Also, it is straightforward to 
show that £6} implies fn < 1- This completes the proof of 
the theorem. B 


where a;(0) = Xq and 0(0) = 0 3 . We say that the system 
in i (34) is almost surely exponentially stable if there exists A > 0 
such that Pr(limsup fc _ > , 00 k~ x log||a:(A;)|| < —A) = 1 for all 
Xq and 0o- The sup remum of A satisfying the above condi¬ 
tion is called the decay rate. To prove Theorem 3.10 we need 
the following criterion for almost sure exponential stability 
of aggregated-Markov jump linear systems in discrete-time. 
Lemma 5.8. Consider an irreducible Markov chain 9 and 
denote its unique stationary distribution by w. Assume 
that A 7 is nonnegative and symmetric for every 7 € P. if 
E [log( 77 (A^( w )))] < 0, then the discrete-time aggregated 
Markov jump linear system in ( j34) is almost surely ex¬ 
ponentially stable with decay rate greater than or equal 
to -E[log(ri(A fM ))}. 

Proof: Let ||A|| denote the maximum singular value 
of a matrix A. Since rj(A) = ||A|| for a nonnegative 
and symmetric matrix A, it is sufficient to show that 
i?[log||Ay( 7r )||] < 0 implies almost sure exponential stability 
of the aggregated Markov jump linear system ( |34) with 
decay rate smaller than or equal to — £ , [log|| Af(^ ||], This 
claim is known to be true if / is the identity mapping, i.e., if 
f(9) itself is a Markov chain 51 Proposition 2.1]. The proof 
for the general case where f(9) is not necessarily a Markov 
chain has the same structure as the proof of Lemma 15.II We 
omit the details. □ 

Using this lemma, we prove the next proposition. 
Proposition 5.9. Consider an irreducible and aperiodic 
AMEI random graph process Q in discrete-time. Let h L;i 
(1 < i < j < n) be independent Bernoulli random 
variables with mean A,,. Define the random matrix 


If 


A /4 — I — D + piPj(Eij + Eji)hij. 

i =1 j>i 

E [log( 77 (M 4 ))] < 0, 


(35) 


a state matrix A~ £ 


then the disease-free equilibrium of £,/ is almost surely 
exponentially stable with decay rate greater than or 
equal to —Elfog(r)(Mf))\. 

Proof: For each k > 0, let A(k) denote the adjacency 
matrix of Q(k). Define the product process 9 on the state 
space A in the same way as in the proof of Proposition |5.7| 
For 7 = ( 7 ij)i,j € {0, l} ra ( n - 1 )/ 2 , consider the matrix 
defined in < [33). Then, in the same way as in the proof of 
Proposition 57\ we can show A(k) = G g ^^y Therefore 
£ is equivalent to the following discrete-time aggregated 
Markov jump linear system p(k + 1) = (BGg(s( k )) + I — 
D)p(k). Furthermore, the state transformation x 1 —> B~ 1 ^ 2 x 
shows that almost sure exponential stability of this system is 
equivalent to that of the following aggregated-Markov jump 
linear system 

£4 : p(k + 1 ) = (B^Gg^B 1 / 2 + I - D)p(k). 

Since the matrix B 1 / 2 G g ^(k))B 1 / 2 + I — D is nonnegative 


for each 7 £ T. A discrete-time and symmetric, by Lemma 5.8 the system £4 is almost 
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surely stable if E[\og(r](B 1 ^ 2 G g ^B 1 ^ 2 + I — D ))] < 0 , 
where n denotes the stationary distribution of the irre¬ 
ducible and aperiodic Markov chain 6 . On the other hand, in 
the same way as in the proof of Proposition |5.7( we can show 
that the random matrices B 1 / 2 G g ^)B 1 / 2 + I — D and M 4 
have the same probability distribution. Therefore, condition 
(35 is indeed sufficient for almost sure exponential stability 
of £4, which implies almost sure exponential stability of 
the disease-free equilibrium of £,/ as we observed above. 
Also, from the above discussion, it is easy to verify that 
—E[log(r](M 4 ))] gives a lower bound on the decay rate of 
stability. □ 

We are now in condition to prove Theorem |3. 10 

Proof of Theorem \3.10\ Applying Proposition |5.3| 
to the random matrix M 4 , we obtain the inequality 
Pr {rifMf) > r]{E\M^f) + s) < k^ a 2 (s). Since A 4 = 
r](BA + I — D) = ij^ElMff), this inequality implies that 


Prf^>l + f 

V a 4 a 4 


— K PA: 


X s ) 


for every s > 0. Therefore, in the same way as we derived 
d30), we can show that 


E 


log 


v(Mi) 

A 4 


< log 


1 + i 


+ K 


73, A; 


,(s) log 


A 4 


and, hence, 


E [log(j 7 (M 4 ))] < log(A 4 + s) + Kg Aa (s) log r]( ' Mmax ' ) . ( 36 ) 

A4 

Therefore, if there exists s £ [0, 1 — A4] such that the right 
hand side of this inequality is negative, then disease-free 
equilibrium of £,/ is almost surely exponentially stable by 
Proposition |5.9| A simple algebra shows that the existence 
of such s > 0 is equivalent to Notice that we do not 
need to consider any s larger than 1 — A4 because, for such 
s, the right hand side of ( [36) is positive. Moreover, the upper 
bound ( fl~9) of the decay rate immediately follows from [36) . 
This completes the proof of the theorem. □ 


6 Conclusion and Discussion 

In this paper, we have analyzed the dynamics of spreading 
processes taking place over time-varying networks. First, 
we have proposed the family of aggregated-Markovian ran¬ 
dom graph processes as a flexible and analytically tractable 
dynamic random graph able to replicate, with arbitrary 
accuracy, any distribution of inter-switching times. We have 
then studied spreading processes in aggregated-Markovian 
random graph processes and derived conditions to guar¬ 
antee that the disease-free equilibrium is almost surely ex¬ 
ponentially stable. A direct analysis based on Ito's formula 
for jump processes results in stability conditions in terms of 
the eigenvalues of a matrix whose size grows exponentially 
with the number of edges in the network. Using tools 
from random graph theory, we have derived alternative 
stability conditions in terms of the eigenvalues of a matrix 
whose size grows linearly with the number of nodes in the 
graph. Based on our theoretical results, we have shown that 
( i ) aggregated static networks approximate the epidemic 
threshold more accurately as the number of nodes in the 
network grows, and (if) aggregated static networks provide 


a better approximation as we reduce the degree of temporal 
variability in the random graph process. 

A possible direction for future research is containment of 
epidemic outbreaks over time-varying networks. Although 
several optimization frameworks have been recently pro¬ 
posed in the literature to find the cost-optimal allocation of 
medical resources to prevent epidemic outbreaks in static 
networks O' © fl3) , jTl), these results cannot be readily 
applied to the case of time-varying networks. 
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